METHOD FOR TESTING 
NON-DETERMINISTIC DEVICE DATA 

FIELD OF THE INVENTION 

5 The invention relates generally to automatic test equipment, and more 

particularly to a method for enabling the testing of non-deterministic semiconductor 
device data. 

BACKGROUND OF THE INVENTION 

1 0 Test is an important step in the manufacture of semiconductor devices. The 

automatic test equipment (ATE), or testers, employed to carry out this task comprises 
sophisticated electronics capable of sending test signals to, and capturing output 
signals from, one or more devices under test (DUTs). ATE software often helps to 
orchestrate this back and forth flow of signals. 

1 5 Conventional testers, as shown in Figure 1, feed tester data signals (drive data) 

originating from a pattern generator 12 to a device-under-test (DUT) 14 via interface 
circuitry commonly referred to as pin electronics 16. Response signals from the DUT 
are captured and compared to expected data with the resulting comparison data fed to 
a failure processor 1 8 in order to determine pass or fail conditions. The "expected" 

2 0 and "drive" data are typically programmed in the pattern generator vector memory (not 
shown) to occur at precise timings, in accordance with how the DUT should behave. 
If the data captured from the DUT fails to correspond with an expected condition, the 
device is considered to have failed that aspect of the test. 

Modern semiconductor devices are trending towards employing multiple 

2 5 processing cores on the same piece of silicon, or chip. Adding to this complexity is 

the overall trend towards implementing on-chip communication protocols including, 
for example, Rapid I/O, Hypertransport, and specialized bus architectures such as 
DDR and source synchronous, etc. The end result is an exponential increase in the 
chip gate count, yet only modest increases in the available pin counts. Consequently, 

3 0 multiple sub-circuits often share the pins (interface). 

This shared interface scheme is illustrated generally in Figure 2, where a 
plurality of device-under-test subcircuits 20a - 20c send data packets to a DUT 
communications port 22 . The communications port serves as the gatekeeper to 
accessing the DUT output pin 24. Each of the subcircuits may be clocked by a 
3 5 separate clock having a frequency different from not only the other subcircuits, but 
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also possibly different from the communications port clock. An asynchronous 
arbitrator 26 handles the sequencing of the data packets to the DUT output pin. 

During typical DUT operation, as shown in Figure 3, the shared interface 
scheme may cause a problem (for conventional ATE) known as "out-of-order data". 
5 This situation often results from the subcircuits attempting to access the 

communications port 22 (Fig. 2) on the same clock edge, or having differing delays 
due to environmental conditions. Figure 3 illustrates the general concept on how an 
expected sequencing may be disturbed into an out-of-order packet sequence. The "out 
of order" data problem presents a unique challenge to automatic test equipment, which 
10 is conventionally dependent on deterministic data from the DUT. 

What is desired and currently unavailable is a test solution for non- 
deterministic data that provides substantially real-time validation results and 
maximizes flexibility for the device manufacturer while reducing test costs. The 
apparatus and method of the present invention provides such a solution. 
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SUMMARY OF THE INVENTION 

The present invention provides the ability for automatic test equipment to 
quickly validate non-deterministic data, such as "out of order" data received from a 
5 device-under-test. This ability is available with little to no impact to the automatic 
test equipment hardware, and is universally applicable to many protocols. With the 
availability of such a solution, users of the automatic test equipment will experience 
significant test throughput improvements and reduced test costs. 

To realize the foregoing advantages, the invention in one form comprises a 

1 0 method for testing semiconductor devices that output non-deterministic entity 
information such as packet and control signals. The method includes the steps 
generating test signals with a semiconductor tester and applying the generated test 
signals to the device-under-test. Actual output entities from the DUT in response to 
the applied generated test signals are captured by the tester and compared to expected 

1 5 output entities. If a failure is identified in the comparing step, the method defines a 
window of valid expected entities and compares the failed actual output entity to the 
window of valid expected entities. If a match occurs between the failed actual output 
entity and any of the expected entities in the window, the actual entity is deemed 
valid. 

2 0 Other features and advantages of the present invention will be apparent from 

the following detailed description when read in conjunction with the accompanying 
drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be better understood by reference to the following more 
detailed description and accompanying drawings in which 

FIG. 1 is a high-level block diagram of a conventional ATE architecture for 
5 driving data to a DUT and comparing the DUT response data to expected data; 

FIG. 2 is a high-level block diagram of a DUT output interface architecture; 

FIG. 3 is a block diagram illustrating the out of order problem resulting from 
the DUT output scheme of Figure 2; 

FIG. 4 is an elevated perspective view of a semiconductor tester employing the 
1 0 method of the present invention; 

FIG. 5 is a flowchart illustrating steps included in one form of the present 
invention; 

FIG. 6 is a flowchart illustrating more specific steps for the compare step of 
Figure 5; and 

1 5 FIG. 7 is a graphical representation of a valid entity window in accordance 

with the method shown in Figure 5. 
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DETAILED DESCRIPTION OF THE INVENTION 

The present invention provides a way to test semiconductor devices that 
employ communications protocol ports that often generate non-deterministic output 
data exhibiting out-of-order results. This is accomplished through the use of 
5 automatic test equipment 30 (Figure 4) that employs software utilizing a unique 

method of analyzing and processing the non-deterministic data for a determination of 
data validity. 

Referring now to Figure 4, the automatic test equipment 30, often referred to 
as a semiconductor tester, includes a main frame 32 coupled to a testhead 34. The 

1 0 testhead houses the various instruments desired by the user to adequately test a 

device-under-test DUT 40. The instruments generally comprise large circuit boards, 
or channel cards, that mount within the testhead in order to interface with the DUT in 
a controlled fashion. The channel cards include the hardware resources that are 
responsive to ATE software in order to carry out the testing of the DUT. Included in 

1 5 the hardware resources for each board are memories (not shown) that store the test 

patterns, expected DUT results and the captured DUT results used for carrying out the 
method of the present invention. 

With reference now to Figure 5, the method of the present invention involves 
steps to analyze and process the test information gathered from the DUT by the tester. 

2 0 The method is tailored to enable the tester to evaluate data from the DUT that is "non- 
deterministic", or does not conform to rigid expected results. In other words, the 
method allows the tester to capture actual data from the DUT, compare it to expected 
data, and if no match occurs, carry out further processing to determine if the device 
still operates within acceptable parameters. 

2 5 Further referring to Figure 5, the method of the present invention lends itself 

well as a modification to existing ATE software packages, such as that known under 
the trademark Image™, licensed by Teradyne, Inc., Boston, Massachusetts, to users 
of its automatic test equipment. Generally, ATE software compiles test patterns for 
application to the device-under-test (DUT), including expected results that are 

3 0 compared to the actual results captured from the DUT. Modifying this general 

approach to enable the tester to handle non-deterministic data involves first creating a 
bus layout file, at step 100. 

The bus layout file created at step 100 includes information describing the 
DUT communications protocol bus architecture. For example, the file includes a 
3 5 parameter identifying how far out of order the actual DUT output packet and/or 
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control signals (collectively referred to as "entities") can be sequenced with respect to 
the expected order without violating the device operating specifications. This 
parameter may be referred to as the device "complexity." Additionally, the bus layout 
file includes pin and frame mapping data to identify DUT pins that define the bus, and 
5 pins that represent bits on the bus. Further, the frame signal pin is also identified in 
the bus layout file. 

Once the bus layout file is created, the expected pattern may be compiled, at 
step 102. As noted above, the expected pattern is a sequence of packets and control 
signals that the tester uses to compare actual DUT output data against to determine 
1 0 data validity. This step is similar to conventional compiling steps for ATE software, 
but includes the capability of identifying both packets and control symbols in a pattern 
file. This is accomplished by locating the entities in the expected pattern, at step 104, 
and generating a list of the entities, at step 106. 

Each entity in the list includes information such as whether it is a packet or 
15 control signal, the "entity order" (its sequential order number in the data sequence 
relative to other packets and control signals), its typeorder (sequential order number 
relative to other packets OR control signals), and its start address and end address in 
the pattern memory (not shown). 

Once the preliminary compiling and list generating steps are complete, one of 

2 0 potentially many tests may be performed on the DUT, at step 108. As generally 

described above, each test involves applying test waveforms to the device, and 
capturing the response data from the DUT. The test step includes the initial 
comparison between the expected entities, and the actual entities captured from the 
DUT during the test, and stored in a capture memory (not shown). 
25 If the entire pattern of expected entities match up with the actual entities at the 

determination step 110, then the device is considered to have passed the test, at step 
1 12, and processing stops, at step 1 14. 

However, if at the determination step 110 a fail is detected (a mismatch 
between an expected entity with an actual entity at a specific DUT cycle), then a 

3 0 modified "compare" step is performed that compares the captured entities against a list 

of valid expected entities, at step 116. 

The enhanced compare step, at step 116 of Figure 5, is more fully shown in 
Figure 6, and explained in more detail below. The step includes first retrieving, at 
step 200, the captured actual data from the capture memory (not shown). Once the 
3 5 data is retrieved, a valid packet "window" is then defined, at step 202. 
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Defining the window, at step 202 involves accesssing the bus layout file to 
determine the entity complexity (how far out of order the entity is allowed to be). The 
entity's "typeorder" is also considered (where the entity should be in relation to other 
entities of the same type). In essence, these entity windows define the allowable range 
5 of non-determinism that each entity can have to still be considered valid data. The 
maximum number of valid entities in the window is defined by the relationship: 

size = (2*complexity) - 1 

10 In other words, the maximum size of the window is essentially twice the allowable 
"complexity" (the number of DUT subcircuits competing to send an output to the 
single DUT communications port). Thus, if a particular entity was supposed to show 
up at a certain cycle (in the original expect pattern), it was actually valid if it occurred 
anywhere within the window defined above. 

1 5 The boundaries of the window are determined by a comparison of the 

"typeorder" number to the entity's complexity. For instance, if the entity was expected 
as the first entity, then the window would not be able to extend into negative numbers. 
The window boundaries may be conveniently defined by identifying the typeorder 
number and ensuring that C-l (where C is the entity complexity) positions are 

2 0 available on each side of the entity for the window. If the positions are unavailable, 
then the lower or upper boundary of the window is the start/end of the entity data. For 
purposes of clarity, Figure 7 illustrates an example for a series of packet entities, with 
different defined windows depending on the TypeOrder (each with a complexity of 
three). 

2 5 The captured entity is then compared to one of the expected entities in the 

window, at step 204. If a match occurs at the determining step 206, then the method 
iterates, beginning with step 200, to retrieve the next originally failing captured entity, 
and construct its window, at step 202. If no match occurs at the determining step 206, 
then another determination is made, at step 207 whether the end of the window has 

3 0 been reached (all of the entities in the window have been compared). If the end of the 

window is reached, then the device fails, at step 208. If the window still has 
uncompared entities, then the comparison step 204 is reperformed with the next entity 
in the window. 

If all of the captured entities match an entity within their respective windows, 
3 5 then the device is considered to have passed, at step 120 (Figure 5) and processing 
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stops, at step 122. Otherwise, as noted above, the device fails, at step 124 (Figure 5) 
with processing halted, at step 126. An expected entity that has already passed cannot 
be reconsidered as part of a valid window. It will exist in the window, but not be 
considered for comparison 
5 As noted above, the enhanced comparison step overrides conventional ATE 

software by enabling it to handle non-deterministic data situations, as needed, without 
wholesale modifications to the tester hardware resources. Consequently, the method 
of the present invention may be conveniently employed in existing ATE systems with 
little additional cost. 

1 0 Those skilled in the art will recognize the many benefits and advantages 

afforded by the present invention. Of significant importance is the throughput 
improvement made possible by the capability of further determining the validity of 
non-deterministic data that originally failed the initial test comparison. By evaluating 
an entity's validity within a window of acceptable parameters, or range of acceptable 

15 operating cycles, more acceptable devices will pass testing procedures. This 
correspondingly reduces the device manufacturers costs. 

While the invention has been particularly shown and described with reference 
to the preferred embodiments thereof, it will be understood by those skilled in the art 
that various changes in form and detail may be made therein without departing from 

2 0 the spirit and scope of the invention. 
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